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ABSTRACT 

The Native Language Arts-English as a Second Language 
Program was designed for economically disadvantaged students whose 
native language was not English and whose ability to read and write 
in English and in some cases in their own tongue was not adequate. It 
was in operation from February through June of 1976 in 14 high 
schools serving 1CCU students in grades 9-12, Depending upon student 
needy a double or single period of small group instruction in English 
as a second language or native language arts was provided* The 
audio-lingual method of language acquisition was used to provide 
systematic and sequential instruction in pronunciation^ sentence 
structure^ vocabulary^ rhythm and intonation patterns of American 
English* Reading and writing were introduced in English as students 
became more proficient. Wherever possible^ parallel programming of 
beginning^ intermediate and advanced level classes was maintained^ 
enabling students to move within as they demonstrated language 
proficiency. As a result of six months^ one term and half-term 
testing of 792 students in grades 9-12^ statistically significant 
differences in English reading and auditory skills were noted for 23 
of the 26 groupings. Where significance was not obtained^ pre to post 
treatment interval gains were observed*"*^' (Author/AM) 
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I. THE PROGRAM. 

Description of the Program 
The Nati.-e Language Arts - English as a Second Language Program 
(Part C) was designed to serve educationally disadvantaged students whose 
native language is not English and whose ability to read and write in' 
English and, in some instances, in their own tongue is not adequate enough 
to perLiit them any degree of success in school. 

In operation in fourteen high schools from Febi-uary 1, 1976 to 
June 30, 1976, the Native Language Arts - English as a Second Language 
Program (Part C) served lOOU pupils in grades 9-12, exceeding the design 
proposal of 850 students • Seventeen teachers and sixteen educational 
assistants administered to these students in small classes of fourteen to 
twenty • The program supplemented the "cax-levy English Class of each school. 
It was introduced to accommodate the overflow of NLA-ESL students in the 
NLA~£3L Program in operation from September 1, 1975, B/E No. O9-6961U. 

Selection of Subjects 
Title I eligible students were selected to participate in the 
Native Language Arts - English as a Second Language Program (Part C) by 
various means: standardized tests; diagnostic tests; referrals by guidance. 
co\jnselors, teachers and friends; interviews; and voluntary enrollment. 
The final criteria for consideration in the program were ratings of C 
througi F on the Puerto Rican Study Scale A, "Rating Pupils ' Ability to 
Speak English," and reading at a level at least two years below grade as 
determined by the Stanford Achievement Test administered shortly after 
initial entry. 

0.5 
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Eligibility for instruction in the native language arts 
ccaaponent vas mandated by functional illiteracy in the student's language of origi 

Program Objectives 

Program Objective No. 1: To obtain a statistically significant 
improvement in students' reading comprehension and auditoiy grade -equivalent 
levels on the Stanfor^l AJiievement Test. 

Program Objective No. 2: To obtain a statistically significant 
improvement in students' raw score reading level on the Cooperative Inter- 
American Test, Pruebas de Lectura. 

Program Methodology 

Students attended a double or single period of English as a Second 
Language and/or a double, or single period of native langx^ige arts depending 
\jpon their individual needs and teacher availability. The audio-lingual 
method of language acquisition was utilized to provide systematic and 
sequential instruction in pronunciation, sentence structure, vocabulary, 
rhythm and intonation patterns. Oral practice drills, visual reinforcements, 
teacher n.\odelling and grammatical review were stressed. As ESL students 
became more pr^Dficient in their spoken language ability, reading and 
writing were introduced. Reading and writing were the focus of the native 
language arts class where oral communication vas already developed. 

Wherever possible, parallel programming of beginning, interajedia^.e^ 
and advanced level classes were maintained enabling students to move within 
as they demonstrated language proficiency. Class trips End excursions were 
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planned from time to time to enrich their experiential backgromd. 

Every effort vas made for students to acquire the basic skills 
needed for their success in school and for their integration into main- 
stream activities. Teachers, educational assistants and ftH personnel 
affiliated with the program displayed dedication, concena and enthusiasm 
for these students. For the most part, a friendly and pleasant classroom 
environment was established irtxich provided students with an enjoyable 
experience and with an atmosphere conducive to learning. 
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II • EVALUATIVE PROCEDURES 
COGHITIVE OBJECTIVES 

Byaluation ab.1ective No. 1 ; It was expected that the mean posttest 
grade-equivalent scores achieved by the treatment group on the Reading 
Comprehension and Auditory Subtests of the Stanford Achievement Test 
would surpass its mean pretest scores at the ,05 level of statistical 
significance when results were submitted to analysis with a t test for 
correlated groups. 

1*1 The Sanrplins ; The treatment group, lOOU students, consisted 
of Ti.tle I eligible students receiving English as a Second Language 
instruction* 

1*2 iMethods and Procedures; The Reading Comprehension ai.d Auditory 
Subtests of the Stanford Achievement Test, Form B, Levels II and III, were 
administered to 792 students on a pre/post basis* 

1.3 Data Analysis : Results were analyzed separately by grade and 
treatment interval with the "Pretest-Posttest (without controls)" design* 
The difference between grade-equivalent means was tested for statistical 
significance at the ,05 level with the correlated t rest* 

1*^ Time Schedule : The pretest was administered in December 1975, 
February 1976 and March 1976 • 

^ de posttest was administered April 1976, 

Complete data were collected from the schools between 
June lU-18, 1976. 
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Evaluation Objective No> 2: It was expected that the mean 
posttest raw scores achieved by the treatment group on the Cooperative 
Inter-ADoerican Test, Pruebas de Lectura, votild surpass its mean pretest 
score at the .05 level of statisticeil significance when submitted to 
analysis vith a t_ test for correlated groups, 

2.1 The Saaipling: The treatment group, 132 students, consisted of 
all Title I eligible students in the Part C Program receiving Native 
Language Arts instruction. 

2.2 Methods and Procedures : The Pruebas de Lectura subtest of 
the Cooperative Inter-American Series, Form CES, Levels I and II, vas 
achninistered to 98 students on a pre/post basis. 

2.3 Data Analysis : Results were analyzed by grade and treatment 
interval with the "Pretest-Posttest (without controls)" design. The 
difference between raw score means was tested for statistical significance 
at the .05 level with the correlated t^ test. 

2.1* Time Schedule : The pretest j/aj3 administered December 1975, 
February 1976 and March 1976. 

The posttest was administered April 1976. 

Data were collected from the schools June lU-18, 1976* 
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PROCESS OBJECTIVE 
Evaluation Objective No> 3^ 

To determine the extent of congruence between the original 
program proposal specifications and actual iurplementation. 

To determine the strengths* and weaknesses of the program in order 
to provide recommendations for recycling, planning and staff development. 

3.1 Methods and Procedures : The evaluator-consultant observed a 
sampling of the fourteen high schools for a total of ten visits. Conferences 
and interviews were held in the schools, at the Office of Bilingual Education- 
English as a Second Language Program headquarters and at the Board of 
Education with all personnel associated with the program: the Assistant 
Director of the ESL Program, principals, department chairmen, coordinators, 
teachers, educational assistants, teacher trainers and the Title I liaison. 
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III. FINDINGS 

EVALUATION OBJECTIVES: 

Evaluation Objective No. 1: To determine whether, as a result of 
participation in the English as a Second Language Program, the asean posttest 
grade-equivalent scores achieved hy the treatment group cn the Reading and 
Auditory C<m)rehension Subtests of the Stanford Achievement Test would 
surpass its ^ pretest scores at the .05 level of statistical significance 
when svibmitted/to analysis with a t test for correlated groups. 

result/: As a result of six months, four months (one term), and two 
months (halfr-term) -csting of 792 students in grades 9-12, statistically 
significant differences in American English reading and auditory skills were 
noted for twenty -three of the tventy-six treatment gi-cups : 

TABLE I 
Stanford Achievement Test 
Levels of Significant Gains 

Length of Treatment 

rpgg^ Two Months Four Months Six Months 

Level Rdg. Aud. Rd^. A ud. Rdg.' Aud. 

Grade II .001 .01 .001 .01 .001 ns^» 

ns ns .001 .001 .05 .001 



9 



III 



Grade 
10-12 



II .001 .001 .001 .001 .001 .001 



III 



.01 ns .001* .001* .001 .001 



• Separate analyses were performed for Grade 10 and Grades 11-1?. In 
both cases, significant gains at the .001 level were attained in reeding 
and auditory comprehension. 



»» ns - no statistical significance 
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In the four treatment groups where significance was not obtained, 
pre to post interval gains were noted by the evaluator-consultant. 
The Short length of treatn^nt, two months, ^ be responsible in part 
for the lac. of significant results in three of the four groups (Level III, 
Grade 9, Reading and Auditory, Grades 10-12, Auditory).. 

5^^^Hation_^iecti^^ To detennine whether, as a result of 
participaticn in the Native Language Arts Px^gram, the mean posttest raw 
scores achieved by the treatment group on the Cooperative Inter-American 
Test, Pruebas de l^ctura, would surpass its mean pretest score at the .05 
level Of statistical signi^cance when submitted to analysis with a t test 
for correlated groups. 

RESULTS: As a result of one term and half-term testing of 89 students 
in grades 9-12, statistically significant differences in native language 
reading were noted for three of the four treatment groups beyond the .001 



level: 



TABLE II 
Native Languags Arts 
Levels of Significant Gains 

i ^Y I^nrth of Trpfltmrnt , Cr^.A. ^ ^.p ^ ^ j ^^^^ ^ 



I^n^h of Treatment 
r^^^, Term Half Term 

Rdg. 



Level 



Grade 
9 



ns* 



II 



Grade 

10-12 II 



>QQ1 ,001 

.001 



ns - no statistical significance 



In the one grotip where significance was not obtained. Level I, Grade 9, 
one term treatment, pre to post interval gains were noted during classroom 
observations. 

^^^^Aa analysis of statistical significance was not made for nine subjects 
whose treatment groups consisted of too few participants, (See Appendix C, 
Table 12, Components with small number of eligible participants, for 
a listing of these subjects and their scores on the Pruebas de Lectura}. 

Evaluation Objective No. 3? 

To determine the extent of congruence between the original program 
proposal specifications and actual irsplementation. 

To determine the strengths and weaknesses of the program in order 
to provide recommenda"cions for recycling, plazming and staff development. 

RESULTS: The ten visits made by the evaluator-consultaiit to the 
project schools observing more than thirty classroom lessons, talKing with 
teachers, ESL coordinators, departmental chairmen and principals, revealed 
that the Native Language Arts-English as a Second Language Program (Part C) 
OS implemented coincided with the program proposal specifications. The 
methodology emphasized the audio-lingual approach in a small class settings 
Aioral-oral skills wer^ stressed m the beginning levels while reading and 
writing were introduced in tlie more advanced levels. Teachers taught a 
single or double period of ESL and/or NLA for a total of five periods. They 
were assisted by an educational assistant who tutored students, especially 
the new arrivals, on a one-to-one basis or in small groups and who performed 
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many of the record-keeping and administrative responsibilities of the 
classroom. The teacher trainers visited the schools regularly. They 
observed classroom procedures, disseminated materials and demonstrated 
techniques to teachers and education all assistants. They also lent 
administrative expertise and support to department chairmen and coordinators 
in their implementation of the program, "me Project Director (Assistant 
Director of Bilingual Education) scheduled conferences dxiring the school 
year enabling teachers and educational assistants to meet one another, to 0 
discuss test scores and to exchange ideas, activities and interests. 
Teachers attended in-service training where necessary. 
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Adequacy of Materials and Facilities 



A variety of print and text materials were abxandantly available 
for teachers to use throtighout the year. The Lado English Series continue 
to be the primary texts during the first and secoad year of JjSL instru vcion 
while, a variety of additional texts and readers were in evidence in the 
more advanced levels. Hines, Skits in American English , Kieszak, Turning 
Point , and the curric\ilum and workbook to accompany it by Baskin and 
Isabella, two teachers in the NLA-ESL Program, were favorites. 

The selection of a text frequently depended upon individual student 
and teacher preference. Teachers were continually encouraged by the teacher 
trainers to tiy different classroom texts, materials and techniques while 
they, in turn, readily suggested additional materials and texts which the 
Office of Bilingual Education might procure for their classes. 

Newspapers were regularly available for students to enjoy. 

Visual literacy focused upon still pictures used frequently and 
successfully to encourage conversation and stimulate vocabulaiy at the 
beginning levels.* Videotaping of both teacher and student performance was 
an extremely effective tool when used on occasion. Filmstrips, slides and 
films for individual or small group instruction were not in evidence. 
Auditory stimuli were limited to the teacher and to an occasional record or 
audiotape. Language laboratories were not in use. A classroom resource 
facility at which students might practice on their own or with the educaticxial 
assistant was not available. Language tapes or records for students to borrow 
overnight were not available. 

Physical plants ranged from large and traditional to makeshift and 

1 ij 
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alternative. Students and teachers appeared to be comfortable under 
all conditions. 

Recommendations from Last Prior Study 
Recommendations from the last prior study are cited below: ^ 

1. "Another level test should be foimd to substitute for the 
Stanford Reading and Auditory Test, Primaiy Level II. Level III of the 
Stanford Achievement Test should be tried for students eveduated as B or 
C on the Puerto Rican Scale, while continuing with Level II, for students 
rated D,E, and F, on the Puerto Ricaa Scale. Criterion reference tests should 
be tried since there is presently no achievement test that is norB«d on a 
representative SMaple similar to this popxolation. " 

2. "The Inter-American Series Test Level I and Level II, should be used 
as both pre- and post-tests. According to the findings reported elsewhere, 
a sizeable number of youngsters are at the tjp or at the bottom of the test. 
Two groups, a Level I and Level II, should be created in the NLA program. " 

3. "Many teachers and chairpersons in ESL and NIfA program find that 
their students need more than two years in ESL. Students slow progress in 
learning to speak and read and write English as shown in the achievement levels 
in this report, concur with the reactions of personnel working with the students . 
therefore, a transitional fifth term of English as a bridge between ESL and 
high school English class should be created. 



1 

c] V al uat i o n Re ]) o r t Native Language Arts-English as a Second Langu.^e Program, 
by F.W. Gpivack. Office of Educational Evaluation. B/E Function Ho. 09-596li*. 
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" Schools that have 3 or more teaching positions in ESL and 
NLA programs need a position of coordinator to oversee its operation and 
organization. It is suggested that the coordinator have special qualifications. 
They are: a. experience in the ESL/NLA program; b. positive human 
relationships with the students, teachers and chairpersons connected with the 
program; c. an understanding and sensitivity to the cultural background of . 
students in the program; d. an ability to guide and counsel st\idents and/or be 
able to refer students for help; e. an awareness of all the forms 
(screening, placement and prescriptive) which m\ist be kept for each student 
in the program; f . a responsible keeping of statistical data for the 
program (book orders, inventories ,* evaluation sheets, drop-out rates, 
discharge rates and accurate testing procedures). See Data Loss Form." 

5. "From statements received from teachers there is a dire need for 

a bilingual psychologist to assist with severe, moderate and mild language 
learning problems. " 

6. "Tiioe and money should be allotted for full day workshops to be 
planned for NLA teachers, ESL teachers, paraprofessionals , coordinators, 
subject area teachers and chainnen of various subject area departments." 

7. " All ESL and NLA material should be indexed and catalogued and 
ordered well in advance. Special materials should be ordered for certain 
schools having special programs. Different models of ESL/NLA programs 
exist in various schools and need specieLl materials. " 
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8, "A continuous evaluation of the students axe needed. 
Attendance and testing figures must be kept in order. Discharge 
students and January graduates must be tested before the youngsters * 
leave the program. See Data Loss Form." 

9. "Coordinators of the program should be given only three teaching 
periods . There should be an silternation of reimburaaVle positions so 

that teachers in those positions can learn prescriptive teaching techniques 
under the supervision of the corrdinator. " 

10. "A proper clarification of student selection in the NLA programs 
needs to be considered. A proper placement of students on various levels 
within the NLA and ESL progreuns needs to be considered." 

11. "A stronger reading component within the ESL/NLA pro^^ram 
needs to be considered. " 

For the nost part all of the above recommendations were implemented 
to the degree to which funds were available. Item n\imbers I, 2, 6 and 
7 have been thoroughly implemented. Items 3 and 5 are being implemented in 
those schools with sufficient personnel. Items 8, 9, 10 and 11 are being 
continually worked upon and improved. For example, criterion-referenced 
testo are being developed by the Program Coordinator and liis staff for 
implementation of the concept of Item 8 above which calls for continuous 
evaluation of the students. Tliese tests are being field-tested in 
preparation for full-scale implementation. 
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Servicing the Needs of the Population 
The Native Language Arts-English as a Second Language Program, 
designed for non-native students handicapped by their inability to 
speak and understand English and, in some cases, by their inability to 
succeed in their own language, serviced the needs of that population 
during the 1975-1976 school year. . 

Cognitive gains in reading and auditoi^y comprehension in English 
were ^realized for the majority of students as measured by the results of 
the Stanford Achievement Test. Cognitive gains in native language reading 
comprehension were also realized by the majority of students who participated 
in' that program as measured by the results of the Pruebas de Lectura. 

Affective gains were recorded as well. Students appeared to be 
receptive to learning and adjusting to their new environment. In most 
of the observed classrooms, they remai.hed attentive and responsive. The 
small ungraded classes, the homogeneous groupings, the variety of materials, 
the teachers' dedication and concern and the overall responsiveness of the 
Office of Bilingual Education - ESL Program headquarters staff permitted 
a positive and heeuLthy atmosphere to be established in the majority of 
classrooms . 

Teachers worked diligently, gave generously of their time and 
maintained a high level of aoraie in their classrooms. Teacher trainers 
assisted them to acquire the desired degree of professioneuLism by 
demonstrating techniques, approaches and materieuLs applicable to their 
perticular needs and temperaments and to their students. 
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Students responded accordingly. Their attendance records 
attest to. the success of the program in providing them with an enjoyable 
experience.* 

TABLE III 

A Coi^arison of Percentages of Attendance 
Between ESL Students and School-vide Population 

Spring 1976 19711,1973 
ESL Students School-vide Popul ation 
Hifi^ School No, % ~ f 

Washington Irving 70 91-58 71,98 

John Jay 73 8O.72 56.97 

Sevard Park 88 82 . 88 70 ,90 

A.E. Stevenson 73 75.51* 71^95 



Ta"ble III presents attendance figures for the Spring 1976 term from 
a sampling of schools participating in the NLA- ESL Program, At each school 
attendance vas higher, even dramatically higher, for ESL students than 
for the students in the mainstream. 

The Native Language Arts - English as a Second Language Program 
served students in excess of its proposed specifications for everyone 
involved in the program felt a responsibility tovards the non-native 
speaker. This sense of responsibility and the high degree of interaction 
betveen the Project Director, the teacher trainers, the teachers, 
educational assistants and students were some of the strengths of the 
program. Everyone vorked to help students adjust to their nev 
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environment and to acquire a feeling of accomplishment, "belonging 
and success hy assisting them in their acquisition of the necessary 
language skills and hy providing them with a genuine sense of friendliness 
and concern. Suggestions for improving the quality of the experience 
are offered in Chapter IV. 
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IV, SUMMARY OF MAJOR FINDINGS, CONCLUSIONS AND RECOMMENDATIONS 

Summary of Major Findings 

1, Program implementation coincided with design proposal 
specifications , 

2, The program's cognitive objective to produce a statistically 
significant ijuprovement in students' ability to read and understand 
English was met for the majority of pupils as shown by the results of 
tae Stanford Achievement Test, 

3« The program's cognitive objective to produce a statistically 
significant impi-ovement in students' ability to read in their native 
language was met for the majority of pupils as shown by the results of 
the Pruebaa de Lectiura, 

Other indicators of improvement were noted during classroom 
observations , 

5. A sampling of Native Language Arts-English as a Second Language 
Program attendance figures indicates that program averages exceed school- 
vide averages demonstrating student satisfaction. 

6, Program personnel, for the most part, are dedicated, concerned 
and professional- 
Conclusions 

On the basis of the above findings and sunmary, it is concluded that 
the NLA/ESL Program met its program objectives. Statistically significant 
grains in reading and auditory comprehension in English were recorded for 
the majority of participating pupils. Statistically significant gains 
in native language reading comprehension were recorded for the majority of 
participating pupils also. 
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Recommendations 

In view of the foregoing evaluative data presented, it is recommended that: 

1. The Native Language Arts-English as a Second Language Program 
be continued, 

2. Every effort be made to provide the program with continuity in 
staffing and activities. The programj^s efforts to establish a stable 
learning environment for promoting success and achievement in language 
acquisition are not supported by the New York City financial crisis: 
Board of Education excessing and relicensing requirements, need to be 
reconsidered. Appf>intment8 to the NLA-ESL Program be cooperatively 
approved by the Office of Bilingual Education headquarters, the school 
principeuL and the on-site ESL Coordinator to ensure consistency and qual.ity. 

3. Assessment and prescription of individual student needs to be more 
personalized and course content modules be established to enable students 
to proceed at their own pace and readiness. 

a. All levels of high school cunri -ilar concepts be integrated 
into the native language arts- English as a second lang^aage classroom to 
better prepare students for entry into the mainstream and to accelerate 
that entry wherever possible. 

b. Record and playback, tape recorders be adapted for individual 
or small group use to iuaprove aural-oral capabilities. Language practice 
cassette tapes and records be available to borrow on a library basis. 

c. Visual literacy be encouraged and stimulated in^ndividual or 
group instructional activities by the increased utilization of TV, films, 
filfflstrips and slides. 
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U. Assessment instruments tc measure teacher and eiucf.itional 
assistant performance be developed cooperetively by the Office of 
Bilingual Education headquarters stsiff , teachers and educational assistants 
to provide everyone with objective tools for measuring performance. If 
possible, modular training programs be developed as part of a reso\urce 
library to correlate with competencies measured and implemented on site as 
needed with the appropriate teacher and educational assistant. 

3. The Stanford Achievement Test be replaced or supplemented by 
another instrument to measure student achievement. Grade-equivalent ratings 
are not viable criteria for monitoring the ESL student. If the instrment 
must be used, alternate fonns should be given on a pre-post basis. 
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The Native Language Arts^English as a Second Lca/sUf-f;*.: ^- o-rrin ^.Part C) vas 
designed for ecoaomically disadvrvroaged students vbose nati-^e lcui.:2:);ar;e is not 
English and whose ability to ree.c. rind " rite in iinglisn s.'-.d i.n scirie instances in 
their own tongue is not adequate- enou^^h to pennio theju irLy :le.;;re.- of success in 
sciiool. In operation from rebT.ory 1, 1976 through Juxie SO. li^Tu in lU high 
schools serving 100^ students j.r grades 9-12, the program .>up:.:?leiTion-oed the city 
tax-levy program. There were IT teachers a;r.d 16 educa^iona./ /u?-.i,:^ijt'jr.ts. 
Depending upon student need, a double or single period of sm-cZ^j. v.?o\:^ instruction 
in English an a Second Language or Nctive I^iigv.^^e or loth wa^-i provided, 

audio-lingual method of language acquisition va'^ uciiizeo »>rovic.e systematic 
and sequential instruction in proni7r.ciation , senceiice i^tr-x:.^^^'-^, vc :aba:Lcuy, 
rbythji and .Intcsiation patterns of v.:" -.can English. hi?c>iir>.'> or.:] -jritiag vere intro- 
duc>i?a i:^. iSnglish as students oecaoie r^-c-:: prcifioient in tre.l - ; ::ox^-a 1 ^i^.^-jiage ability 
Qxxo .'Jt;.j-eef!Od in the native IvJiguage where oral coiraai^ic .':'::ic^i vi^v^ "^^rioped. 
Wherever possible ^ parallel progr&mming of begimiin/^-, in :.e:i ne iiate ind f^dranced 
level classes were ntained enabling students to move viUiLd cir. they demonstrated 
lang'tiage proficiency- 

The cognitive achievement sought to determine vhctr3'--r .:tu&nr.3 -mo participated 
in the program would obtain a statistically significar.t ir^proverjc^Ltt in their I^aglish 
reading and auditory skills and in their native len^/urr.e rejvJvri^ level. Tbe Reading 
CoHiprehension and Auditory Subtests of the Stanford Aehie-.e?aeut Tesc were administered 
on a pre/post basis to 792 students. The difference betveeu gx^ide f!q-.jLi*/alent score 
means on each subtest was submitted to analysis with a test 7*or cori^lated groups 
and tested for s^ignificance at the .05 level. The Prueber. ae Lectura Subtest (Reading) 
of the Cooperative InterAmerican Series veB administered to 12 3 at^jdents on a pre /post 
basis, .The difference between raw score means was tested for statistical significance 
at the .05 level with the correlated t^ test. 

As a resixlt of six months, one term and half-t^rai t^.^.3'::u^_; of 792 students 
in grades 9-12, statistically significant dif i^ni-ences fcrlii:'h raading and auditory 
skills were noted for 23 of the 26 groupings: Levpl li , Gr^iae 9, ^ix months (Reading 
only); one te?na and half-term treatment: Gracie 10-12.. s:.x lacnohs:. ote term and half- 
term treatment; Level III , Grades 9-12, six months, one ter^ii and half-term treatment. 
As a result of one term and hiaf-term testing of 98 students irx grades 9-12, 
statistically significant dif:rerences in native Ituguagt^ reaiin^; .levels were noted 
for I^Tel 11 ^ Grades 9-12. Tnere significance vas not obtLdned,. pre to post treatiaent 
intarval gains were observed. Ten visits to th£: prefect L^:?h.r»;L^ rev^CLled that the 
'program as in^jlemented coincided with the specifications ci :;Le dec.i.gii proposal • 
Participating students were provided with an atmosphej.^ ecndvici re co their learning the 
basic skills of English and their native language and to their ?nt":^^:^r^ition into the 
mainstream. 

It is recoKmended that the program be refunded ac c\w±^r\t je\^^ls far the 1976-1977 
School year. The following are cil^o sugp:ested in the plrjnninf: ^\jia development of future 
programs: continuity and stability in staffing be tvirdataii; e i; i-.uden^ assessment and 
prescription be more personalized: educational iied.\ 1 ce in >?,.-.r:rt-ec'. into ^:he program; 
instruments to measure teacher and educational. as3istar:t p^-r^''or:n.?r^oe be developed 
along with on-site training programs; «nd the Stanford T^st be replaced or 

supplemented by another instrument to meeisui-e EngliL.h :i3 a vec-:::d L<Xi'iguage achievement. 



' APPENDI X B 

TiBTeTl Horo refersnced achievement data not applicable to Table 9. 

HATIVE LAHGUAGE ARTS-EMGLISH AS A SECOND LANGUAGE (P/iRT C) 

In the t&blie braXoVi enter the requested aoaessment Information about the testt 
Ivdnesfi of :MiJor project component/activities In achieving cognitive objective 
read all footnoti^s* Attach additional sheets if necessary • 



Component 
Code 


Activ- 
ity 
Code 


Test 


Porro 


Level 


Total 
N 2 / 


Group 
ID 3/ 


N 

it/ 


Score 


Pretest 


Used 

u. 


Pre 


Post 


Pre 


Post 


Date 


Mean, 




6 


1 


k 


1 


5 


0 


0 


7 


2 


0 


Stanf. 
Bdf. 


B 


B 


II 


II 




9 




1 


12/ 
...Z'j. 


1.76 


.63 


6 


1 


k 


1 


5 


0 


0 


7 


2 


0 


Stanf. 
Aud. 


B 


B 


II. 


II 




9 


ko 


I 


12/ 
75 




.62 


6 


1 


k 


1 


5 


0 


0 


7 


2 


0 


Stanf. 
Pig. 


B 


B 


II 


II 


196 


9 


11k 


1 


2/ 
76 




.77 


6 


1 


k 


1 


5 


0 


0 


7 


2 


0 


5t.wif. 
kvd. 


B 


B 


II 


II 


196 


? 


Llk 


1 


2/ 
76 


L.UO 


.79 


6 


1 


k 


1 


5 


0 


0 


7 


2 


0 


Stsnf . 
Rd^ 


B 


B 


II 


II 


6i+ 


9 


k9 




3/ 
76 


L.U9 




6 


1 


k 


.1 


5 


0 


d 


7 


2 


0 


St&nf . 
Aud. 


B 


B 


II 


II 


6k 


9 


k9 


1 


3/ 
76 


L.20 


.k9 












































0 



1/ Identify teat used and year of publication (MAT-58; CAT-70, 
etc.) 

2/ Total number of participants in the activity. 

2/ Identify the participants by specific grade level (e.g., 

grade 3, grade 5). Where .se,veral grades are combined, 

enter the 4th and 5th digi»:e of the compotient code. 
4/ Total number of participants for whom both pre and post 

test data are provided. 
5/ 1 - grade equivalent; 2 - percentile rank; 3 - z score; 
*" 4 publisher's standard score; 5 " stanine; 6 « raw 

score; 7 " other. 



6^/ Stand 
the f 

rUaga 
Yonlta 
7/ Test: 
8/ Ohtai 

» Stati; 
Statii 
ns No at; 



DIX B ' ii 

Norm referenced achievement data not applicable to Table 9. 

KATIYE LAIGUASE ARTS-ENGLISH AS A SECOND LANGUAGE (PART C) 



FUNCTION NO. 09-69686 
Page 2 of 5 . . 



2 table below, enter ths requested assessment Information about the tests used to evaluate the effect- 
38 of major project component/activities in achieving cognitive objectives. Before completing this, form, 
all footnotes. Attach additional sheets If necessary. 



It 


Activ- 
ity 
Code 


Te«t 


Form 


Level 


Total 
N 2/ 


Group 
ID 3/ 


N 
A/ 


Score 
Type^ 


Pretest 


Posttept 


Statistical 
Data 


Used 
1/ 


Pre 


Post 


Pre 


Lost 


Date 


Mean 


S.D. 


Date 


Mean 


SJ. 


7/ 

Test 


Value 


0 


0 


7 




0 


Btanf. 
Rdg. 


B 


B 


III 


III 


3lt 


9 


27 


1 


12/ 
T? 


3.1i7 


1.1* 


\l 
) 76 


3.?6 




Corr< 
t 


2.32 » 


3 


0 


7 


2 


0 


Stinf. 
And. 


B 


B 


III 


III 


31* 


9 


?7 


1 


12/ 


3.0; 




\l 
76 


3.61 


1.0; 


Corr. 

i t 


3.28 »* 


D 


3 


7 


2 


0 


Stanf. 
Rdg. 


B 


B 


III 


III 


107 


9 


92 


1 


2/ 


vl.6$ 




f 






Corr. 
t 


7.,fil 


) 


3 




2 


3 


Slanf. 
Aud. 


B 


B 


III 


III 


107 


9 


92 


1 


2/ 
76 


2.82 


1:6c 


76 


3.58 


1.61 


Corr. 
t 


8.22 »» 


3 


3 


7 


2 


J 


Rdg. 


B 


B 


III 


III 


51 


9 


19 


1 


3/ 
76 


!*.l6 


1.5? 


i/ 
76 


1*.62 


1.82 


Corr. 

\ 


1.83 as 


3 


3 


7 


2 


3 


itanf. 
Aud. 


B 


B 


III 


III 


51 


9 


19 


1 


3/ 
76 


1*.02 


1.3: 


ir 

76 


1*.03 




Corr. 
t 


.10 ns 


































Conl 


,inue( 


i nexl 


pa* 


e 





y test used and year of publication (MAT-58; CAT-70, 

umber of participants in the activity, 
y che participants by specific grade level (e.g., 
, grade 5). Where several grades are combined, 
he 4th and 5th digits of the component code, 
lumber of participants for whom both pre and post 
Lta are provided. 

de equivalent; 2 « percentile rank; 3 ■ e score; 
Usher' 0 standard score; 5 stanlne; 6 ■ raw 
7 " other. 



I 

ro 
I 



6/ standard Deviation - only required of 
the following districts: Albany, Buffalo, 
Hempstead, Mount Vernon, New York City, 
Niagara Falls, Rochester, Syrricuse. Utlca, 
Yonkers. 

7/ Test statistics (e.g., t; F; X^). 

8/ Obtained value of test statistic (e.g. Fal3.25 



* Statistically significant at p^.05 
** Statistically significant at p<5:.001 
as Mo statistical siguificiace 



29 



ERIC 



APPENDIX B 

Table U Horo referenced achlevenent data not applicable to Table 9. FUNCTICfl N0,09-69686 

> I 

NATIVE LANGUAGE ARTS-ENGLISH AS A SECOND LAMGUAGE (PART C) ' ^^^^^^^ 

la the table below, enter the requested assessment information about the tests used to evaluate the effect- 
iveness of major project component/activities in achieving cognitive objectives, Before completing this, form, 
read all footnotes. Attach additional sheets if necessary, 



Component 


Actlv- 


TeflC 
Used 

1/ 


Fonn 


L?,vel 


Total 
N2/ 


Group 
ID 3/ 


N 

/./ 
Z' 


Score 

M ft t 

TypeA/ 


P: 


re test 


Posttest 

....... .. . i . 


Statistical 
Data 




Code 


1 
( 


]ode 


Pre 


Post 


Pre 


Post 


Dat< 


Mean 


il 

S.D. 


Date 


Mean 


SJ). 


y 

Test 


Value 




1 




1 


6 


0 0 


7 

( 


2 


0 


nog- 


B 


B 


II 


II 


,12. 


10-12 


d5 


1 


12/ 
15 


2.08 




il 
16 


2,31 


,65 


3orr. 
t 




,6 


1 


k 


1 


6 


0 0 


T 


2 


0 


StanT 
Audi 




B 


II 


11 








I 


12/ 


1.3? 




16 


L.62 




3orr. 
t 




6 


1 


k 


1 


6 


op 


T 


2 


0 


Stanf. 
Rds. 


B 


B 


II 


II 


122 


10-12 




1 


76 


11] 


.8 


1/ 
76 


?.66 


•11 


;orr. 
t 


6,6?" 


6 


1 


k 


1 


6 


0 0 


T 


2 


0 


Aud. 


B 


B 


II 


II 


122 


10-12 


98 


1 


2/ 
Ti 


L.85 


.99 


'1/ 
T6, 


!.26; 


L.O? 


;orr. 
t 




6 


1 


k 


1 




0 0 


T 


2 


0 


srsiri: 

Rdg. 


B 


B 


II 


II 


56 


10-12 


llO 


1 


'3/ 
76 


!.15 


.5 


V 
16 


2.38 


.>3 


t 


1|.20»» 


6 


1 


k 


1 




0 3 


1 


2 


0 


Aud. 


B 


B 


II 


II 




10-12 


1*0 


1 


3/ 
76 


1.29 




V 
16 


1.5T 


.63 


Corr 
t 


ll.O ** 
















ir_L 




























lued I 


lext I 


lage 







1/ Identify test used and year of publication (MAT-58; CAT-70, 
etc) 

2/ Total number of participants in the activity. 

}/ Identify the participants by specific grade level (e.g., 
grade 3, grade 5), Where several grades are combined, 
■enter the 4th and 5th digits of the component code. 

4/ Total number of participants for whom both pre and poet 
test data are provided, 

5/ I ■ grade equivalent; 2 ■ percentile rank; 3 ■ z score; 
" '4 ■ publisher's standard score; 5 " stanlne; 6 ■ rav 
score; 7 ■ other. 



I 



6/ Standard Deviation • only required of 
the following districts; Albany, Buffalo, 
Hempstead, Mount Vernon, New York City, 
Niagara Falls, Rochester, Syracuse, Utlca, 
Yonkers, 

7/ Test statistics (e.g., t; F; X^). 

8/ Obtained value of test statistic (e.g. F«13.25 



Statistically significant at p(.0Ol 
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Table U Nora referenced achtevement data not applicable to Table 9, 
NATIVE LANGUAGE ARTS-LHGUSH AS A SECOND UIIGUAGE (PART C) 



rmm no. 09-69666 

Page 1* of 5" . • 



In the table b^lov, enter the requested assessment Information about the tests used to evaluate the effect- 
iveness of oajor project component/activities in achieving cognitive objectives, Before completing this, form, 
read all footnotes, Attach additional sheets if necessary, 



CoDpoaeot 


Activ- 
ity 
Code 


• Test 

U86Q 

1/ 


Forni 


U 


ivel 


Total 
N £/ 


Group 

ml/ 
ID J/ 

mm 


IT 

N 


Score 
Typej/ 


Pretest 


Postte, 


)t 


statistical 
Data 


Code 




Pre 


Post 


Pre 


Post 


Date 


Mean 


S.D. 


Date 


Mean 


0/ 

srD. 


y 

Test 


Value 


6 


1 




30( 


)? 


2 ( 


Stanf 


J. 


B 


HI 




TO 




lift 


,1 


12/ 

-i 


]M 


1.0; 


I 






Corr. 


T,25"., 


6 


1 


\l 


dO( 




2 ( 


Stanf 






III 




TO , 


10-1? 






12/ 

T5 


2M 


1.3i 




3.2I1 




Corr. 




6 


1 




3 0 ( 


n 


2 ( 




B 


B 


TTT 
111 


TTT 
111 


he 


10-12 






3/T6 


1*.08 


.93 


w 


IS' 


J. a 


Corr. 


2.3T* 




1 


^i! 


D 0 ( 




2 ( 




[x 


B 


ni 


III 
















V 
T6 


1.2c 


Corr. 

t 




6 


\ 




>0( 




2 [ 


:Jtaaf. 


B 


B 


III 


III 












l;.l8 


6 


1 




5 0 ( 




2 ( 


Staiif 
) J^\^d. 


B 


B 


III 


III 


^6 








21% 


It 


l.l|( 


v 

16 




kI3 


Corr. 
t 




6 


1 


\} * 


3 0 ( 


ii 


2 ( 


Staaf 
) Rd|?. 


B 


B 


III 


III' 






J?. 




2/T6 


3.83 


.99 


^/ 
T6 


I1.38 




Corr. 

t 


5.90*» 


£_ 


ii 




5o( 


)? 


2|t 


Stanf 

) Aud. 


1 

B 1 B 


III 


III 




10 


12 




2/T6 


3.66 


1.39 


It/' 
T6 


l02 


1.52 


Corr.i 

t ^.m - 



1/ Identify test used and year of publication (K^T-58; CAT-70, 
" etc.) 

2/ Total number of participante in the activity. 

3/ Identify the participants by specific grade level (e.g., 

grade 3, grade 5), Where several grades are combined, 

enter the 4th and 5th digits of the component code. 
4/ Total number of participants for whom both pre and post 

test data are provided, 
5/ 1 ■ grade equivalent; 2 ■ percentile rank; 3 ■ t score; , 
" 4 ■ publisher's standard score; 5 ■ stanine; 6 ■ raw 

score; 7 ■ other, 



I 



, ^ Continued Next Pige , , , 
0/ bcandaro ueviauon ■ m) rf.qulreu 01 

the following districts; Albany, Buffalo, 

Hempstead, Mount Vernon, New York City, 

Niagara Falls, Rochester, Syracuse, Utlca, . 

Yonkers. 

7/ Test statistics (e.g., t; F; f)s 

8/ Obtained value of test statistic (e,g, P"13,25 



* Statistically significant at p^.01 
Statistically significant at p^.OOl 
ns No statistical significance 
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APPEHDIX B ■ 

Table 11 Honn referenced achievement data not applicable to Table 9, 

Htm UHGUAGE ARTS-ENGUSH AS A S.ECC«D LANGUAGE (PART C) 

h -the table belov, enter the requested assessment Information about the tests used to evaluate the effect- 
iveness of Mjor project component/activities in achieving cognitive objectives, Before completing this, form, 
read all footnotes, Attach adj'.Jtlonal sheets If necessary, 



CoDponent 


Activ- 
ity 
Code 


' M 
Used 
11 


Form 


u 


!vel 


Total 
N2/ 


Group 
ID 3/ 


N 
4/ 

Pi* 


Score 
TvoeSy 


P] 


tetest 




Pdsttest 


Statistical 
Data 


Cede 




rre 


zQqI 


Pre 


Post 


Date 


Mean 


6/ 






6/ 

0 


7 

■•t 

iest 


Vilue 


6 


6 




5 0 




2 ( 


Pruebj 
3dcLec; 


CES 




I 


J 


18 


Q 


lli 




21 


55 86 




V 


^1 70 


n 


Corr, 
U— 
Cob. 
Li_J 




6 


6 


n 




u 


2 ( 


3deLect 


CES 


CES 


l\ 


11 




q 




i 


2/ 






V 

-?()... 




19.2 


6 


6 


u 




?,i 


2 ( 


hruebj 
3del£ct 


CES 


CES 


11 


H 










3/ 

3/ 
Tfi 


53.32 


I^ 
?2.? 


1;/ 






dorr, 




6 


6 


n 


S 0 1 


5 T 


2 ( 


)deLect 




CES 


II 


II 




10-1^ 


Corr- 






























































1 














































































■ II II) 



6/ Standard Deviation - only required of 
the following districts; Albany, Buffalo, 
Hempstead, Mount Vernon, New York City, 
Niagara Falls, Rochester, Syracuse, Utlca, 
Yonkers. 

7/ Test statistics (e.g., t; P; X^). 

8/ Obtained value of test statistic (e.g, F"13.25 



Statistically sigaificant at p^QOl 
ns No Statistical Significance ^ 



I 
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1/ Identify test used and year of publication (ET-58; CAT-70, 
etc) 

2/ Total number of participants in the activity. 

3/ Identify the participants by specific grade level (e.g., 

grade 3, grade 5). Where several grades are cooblned, 

enter the 4th and 5th digits of the component code. 
4/ Total number of participants for whom both pre and post 

test data are provided. 
5/ l ■ grade equivalent; 2 ■ percentile rank; 3 » s score; 
" 4 ■ publisher's standard score; 5 ■ stanine; 6 ■ raw 

score; 1 ■ other, 



er|c 34 



by a^v ^ompo 



sr- t:; ■>"i;e :::c following . ■; v'"" ^^c'l pup'l by rai^ic; a ■i'^.v. 

Qci:. '^■::}:1 ~ Tr^'ni^n' ■rt\::}!"L '"^ui^^or, and give co^-'''^^' 'j:"': " ' or each pupil 'r-r'i'-^ted 

m :abi/ Before co::p:o'.l.:g ;::is forni, read c.W "^^^-ot'^^ ^'dditinn^l shoots i!; rec-^s^^ary, 

i™5LL FUNCTION NO. 09-69666 



SATj VE LftNGIj/iGE AR^^^NSUSH S BCO an^lAHGUAGli (PART Cjl 



rosttest 



NWoer of 



Screening 



••■ , Code . Code 'Used' Pre PcstiPre 


PostjLevel IV;:? "'. - "yce Standard 
! . -c: .'. ! Scored 


Contact Test! Date | Standard 
Hours y , 1/ Score 1/ 


1 6'6ti:5^0;0 I'a'oideLec 


a 1 i 
tCES'CES^ I 


— W~- " : 

I 1 9 75 30.0 lt/76 li2,5 


est. fruebaU/ 
50 hrs.cleLect.75 


30.0 


i ; i i , ' f*rue^ 
2 6 6 Tll5;0!o' t' 2 0 ideLec 


tCESjCES; I 


i 12/ 

1:9 75 6o;o it/76; 67.5 


est. ["ruejia 12^ 
50 hrs. delect. 75 


60.0 


■ , ; ■ ' ■ ' Pruebla 

3 6,,6:7;i'5:o;o j;2;0 dfiLect.CE^CESlII 


: 12/ 
II : 9 75 88.0 : 81,82 


est, Prueba 12/ 
50 hrs.SeLek 7)! 83.0 


l| ^6'6'T'i:5'oV7;2'0idftLec 




12/ est. Prueba 12/ > 
m 9 75 63.6I! ' it/76' 62..T3 i 50 hr3.'|ieLect.75: 63.61 



I ■ I 



i ^ fruei^ j ■ I 12? ■ , ;est, frueba 12/ 

j_;6i^'7;iyQ;oi7i2'O deLeflt.CES CES'lI jll ' 9 ' 7 5 57-27 V76' 8C.0 i 50 hrs.fi8Lect,75 



est. "Prueba ut 
I1/76 6ii.55 i 50 h r3.delej:t.75 
es^^ miepa 'if 
V76 71.25 : 27 hrs.delett.76 



57*27 



6 



'li5;0^0:7;2iO;deLec^.CESjCES II ill ' 9 



13.61< 



13.6/^ 



7 '6;6'7a;6;o:Q;7!2j0^eLeqt.CES|CES! I I I !l0>12' 2/76 72.5 
■ ■ . ' ' Prim \ ' i i 

8 ;6;6'7l6:0'0'7 2'0'iieLecLcES:CJ 



72.5 



I ' I 110-1212/76 76.25 



'(}io;7:2:o'deLeclC£S 



lesfi RnieBFTT 
li/76; 82.5 ! 27 hrs.deLett.76j 76.25 



IsT, Frueba lii/ 



9 



CES ' II : II : 10-12 



IF 



75 ^78.18 ■ W 97.27 I 50 hr3.|ieLei!t.75| 78.18 



1/ Identify test used and year of publication (ET-58 readir,; CAT- - etc). 
2/ Pu '^lisher's Standard Score. (See publisher's manual). Scaler! '^co'-cs are also acceptable. 
)! E-^ter the total nup.ber of contact hours that this Individual rc-c-iivcd i:: supplementary services from 
this funding source. 

■'4/ (Sa-e as •?! above). The screening test is the test that vr.s o"?lcyed to establish eligibility during 
the needs assessment/planning phase of the project, ' ' 



OFFICE OF ED TOOmv/lLliiV flUN - DAT A LOSS ?m APPENDIX D 

(niflcli L'o mmm) ' " Function I 

■NATIVE LAiNGUAGE ARrS-EHGUSH AS A SECOND LaCUAGE (PART C) ., 
In thlB table enter all Data Uisa Infornvulon. Between thfi MIR and this form, all partlclpanto in onch Activity 
mt be accounted for. The componput m\ nctlvity c.oden used In completion of the HIR Hhould bo mA here 90 thnt 
:he two tables irtatcli. See deflnltionfi below tnble for further Inst rue tlona, 



Component 
Code 



6 



^15 



6ll»l 



1^ 3 



r I 



5 ) 



Activity 

Code 



:: 1 



C ! 



(1) 

Group 
I.D. 



9 
9 



(2) 
Test 
Used 



Stanf. 
Hdg.II 



0) 

Tola! 



Number 

I'GSted/ 

Anflly-f.>d 



30? 



iStauf, -y,- 



T 



2 



10-12 



10-12 



AviJ.1 
Stanf. 
Rdg.IlL 
Staiif. 
AudEI 



10-12 



10 -12 



Stanf. 



Smt. 
Staiif. 



30) 

192 
192 



250 



stanf. 

Prueba 
I+II 



10-12 



II 



250 
25T 



25T 
39 



3^ 



'63 



1^1 
138 



(5) 

PartlclpantB 
Not Tested/ 
Analyzed 



l»2 



13& 



aajie as "above 



203 



203 



188 



61 



28 



51* 



5I1 



I ^ I 'JlDcomplete Pretest (U); Late Admit (2 ) 
Sa|e^ ab()ve„ „ ;.Truant Pretest (l); Posttest 
discharged (8); Transferred (l) 



69 



28 



6 



7. 



7r 



13.8 



:f3.8 



28.1 



28.1 



Reaoons Why Students Were Not Tented, 
Or If Teoted, Were Not Analyzed 



Absent Pre {15) or Posttest (6) 



Truant (3); Late Entry (3) 
' "ni^r-hflr^p^ j^ ]. Returned Puerto Rico (2) 



^fAbsent Pre (10), Post (6), Both (9) 
l5i££l2L^!Jl^tesyiiJ_;j^^ 



Jruant 

l}i£charged ( 3); Moved (2); Trans ferredC* 



/Absent Pre C^l^Both (3) 



2g g lAbsent Pre (26); Posttest (I8) 

\| Incomplete Pretest (3); Late Entry (l) 



Saje m abciv^ q ^ Truant posttest 
Discharged 



31.5 



1T.6 



Absent Pretest, Posttest or Both 
Incomplete Posttest Results 



Absent Pretest, Posttest or Both 
Incomplete Posttest Results 



Nunber 
21 

6 

25 
16 



f 9 



IT 

A 
5 

JL 

A 
13 

6 



2li 
k 



[\) Identify tlie participants by specific grade level (e.g., grade 3, grflde 9). Wliere several grades are combined 
■ enter the last- two digits of the component code. ' 

(2) Identify. the teat used and year of publlcfltloii (HAT-70, SDAT-74, Houghton MlffUn (IPMS) Level 1 etc.) 

(3) Number of participants in the activity. 

[h) Number of participants Included in the pre and posttest calculations, 

(5) Hunibcr and percent of participants not tested and/or not analyzed, 

(6) Specify a_U rcesona wliy students vere not tested and/or analyzed. If any further documei^tatlon Is available, 

please attach to this form. If further sp,ice Is needed to specify and explain data loss, attach additional 
pages to this form. 

(7) ''"^''ich reason specified, provide s spparate number count. 
ERIC 



■39 



